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ABSTRACT 

Concerned with the validity of the. audience datar 
reported By two major syndicated magazine readership 

services — Mediamark Research Inc. (MRl) and Simmons Market Research ^ 
Bureau (SMRB) — a study examined/the differences in MRI and SMRB 
calculatipns of reader 'turnover rates, which form the basis fdr 
estimating audience accumulation. Results indicated that'the MRI 
recent reading method of determining audience accumulation tended to 

produce significantly lower turnover levels than the SMRB 

two-interview method, but that the differences were contingent on 
circulation size. MRI turnover levels, for example, were no different 
than those prbvided by SMRB for publications with circulations under 
500,000. The reason for this finding may have been based on complex 
interactions of the proportion of in-home to out-of-home readers, the 
circulation Size, and the frequency of reading measure. Since SMRB 
and MRI defined readership differently, the findings did not indicate 
which method of determining audience accumulation was most effective. 
(MM) 
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A Comparison of MRI and SMRB 
/ ■ . ' ■ ■ ^ ■ . ' • 
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The validity of the audience da t a r ep o r t ed by the two 
major syndicated magazine readership services — IIRI and 
SMRB — remains a hotly debated issue. Most ^-esearch to date 
has focused on the single-issue readership estimates 
provided Jj^y these services. The present study addresses a 
secoild issue, of at least as much impo rt ance--aud±ence 
accumulation estimates* 

In this study, we examine differences in MRI and SMRB 
turnover rates. Which serVe as the basis for estimating 
audience accumulation. Our^results indicate that while MRI 
tends to produce, on average, lower turnover rates than 
SMRB, differences are dependent upon magazine circulation 
size. We argue/that the reason for this finding is baseci on 
a 'compJ.ex interaction of in-home 'and out-of-h6me readership 
lev.els, circulation size , and the f r equehcy-of-read ing ' 
question used by MRI to estimate turnover. .> ' ' 

«•.*•■' ■ ■ ** . 

Presented to the Adver tis ing Division, Association 
fox .Education in Journalism and Mass Communication, 
.National Convent ion Ga inesvi lie , Florida, August, 1984. ^ 



Examibing the Validity of Audli^jOT^^|^tumula t ion Measures: 
' A Comparison of;?|^^^|k SMRB 




Int roductibtf^ 

The validity of magazine audience ^^i^asurement s, used by 
the two major magaz ine r eade r ship serS!^i''ces , > Mediamark > 
Research Inc. (MRI) and Simmons Ma fJ^i^t Research-Bureau, • 
Inc. (SMRB), remdins a key issue for a' majority o'f media 
researchers. SMRB uses an issue-specific metfiod referred, to 
as "through— the-book , " while MRI employs a "recent reading" 
or time-specific method. Little was published on these 
methods until 1978, when W.R. Simmons *and Associates, Inci- 
merged with TGI to form SMRB. SMkB then decided to combat 
the problem of measuring a large number of magazine titles ^ - 
in a single study by combining their thr ough-the-book* metho"d 
wi^th^TGI's form of recent reading. This new combined 
^measurement technique ra^ised questions and increased concern 
about the "comparabi^.ity" of these two conceptually and 
method^ologically differing approaches. 

These concerns were strong enough ^Q^^rompt an 
Advertising Research Foundation (ARF) Comparability Study in 
r979. The purpos^e of the study. was "not to evaluate the 
alccuracy or -appr^opriateness of either ol the two magazine 
measurement methods •..."but to determine the degree and 
patterns of '%i f f e r ences ' be tween the two methods.*" (Gatty, 
1980) 'y^Samuels , J . Walter Thompson's Re'seairch Directot , 
echoed this s ent Iment , ' say i^ig , "It doesn't kake a difference 
which seyice is wro^g.or right because the definition of 



readeV is*%not the same...MRr simp ly br oadeus ^he definition' 

to include lookers^or seers, not actual readers (Lechten, 

1980) " ^ ' *' ^ ' ' ^ 

. ^ ' • ' '"' . ' " • ■ "* 

ARF dis.c0vered that the .SMRB' recentr-reading method ' 

produced audl>ence levels significantly Tiigher than the thixed 

^ \- ^ . ' . ■ ' 

* th^ough-the-^ook method for all magazines , ^specially .among 
■"readeVs claiming • to hav^ i;ead outside of their hoirie (ARF 

• ' ■ \ t ' . ■ ^ 

Comparabilf^y Study, 1980). ^ A .198'3 report by Be.rn.stein and 

Montoya Confirms this* conclusion. Their analysis shows that 

MRI records a* 44% higher' level of readership than SMRB , with 
MRI recording twice as many out-of-home or incide,ntal 

v-" ■■ , ^ .. r . ' , ■ ^ ' 

readers as SMRB. They . ta 1 1 r ib ut e t h is difference to the 

inability of SMRB' s issue-specific method to include 

J.ndivi>du*als who have experienced a brief or incidental 

jexp^sure to a magazine. ^SMRB's S'skeletdriized" test issue 

' • ■ ■ . * ■ 

may not be recognized by an incidental olt casual reader . 

^(SMRB removes all but the ed^-to rial content of the magaz;Lnes 

studied) . 

This comparison of SMRB' s througl^- the-book and recent- 
^^eading method has .been 'generalized fc^^^Jh^clude any recent- 
reading method, specifically MRI's.- Mariy mag^jirie articles 
(Papazianv 1980; Rozen, 1980; Marketing and Media Decisions, 
1979 and 1980 ; Lechten, 1?^0) have been written iLn response 
to this contr ove'rsy . To th^s date, however., no one has a 
solution to this magazine audience measurement i^oblem. 

While most discussions thus far /have focused on single- 
'issue reaiership estimates., magazine s*chedul ing is n/pt based 
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solely upon these figures..^ Rather, med ia p lanneir s must \ 
consider various/ estimates of audience accumulation in' 
calculating the reach atid frequency of various^ vehicle 

comb inat ions • Therefore, the'fpcus of our stqdy is upon 

I ' ' ' ' ■ ' . . . .\ 

audience turnover levels — the figures used in calculating 

/audience accumulation. The following is a brief review of 

^the previous research on the turnover rates of MRI and' SMRB. 

As has been documented (Richar^ and Frankel, 1983 j/ 

PavXik, 1983), the MRI recent- reading technique and, -SMRB 



through-Che-book magazine readership meithod produce > ' 
significantly different turnover levels. ^Differences 
between the two- sets bf turnover levels are apparen.tly due 

to methodological differences in the yays'in which they a^re 

. ■ . . / ' ^ ; . . ■ 

determined. While SMRB' employs a two-interview technique to 

estimate average issue a,udience and t uxnover MRI use^ a 



t s 



ingle intes^/iew to determii^e avevrage .issue a'ud\en<:e^with a 
frequenty-of-reading quesV ion added , to ^es t imate turnover . 

A 1^83 study ^by Richard^and Frankel (using 1981 'data) 
,shows that tHe MRI method tends ^to p rod'cic e^ ignif lean tl y 
lower turnover level-s than the SMRB method. They ascertain 

that since the SMRB two- int efview method is based on "^tV^ ^ 

■ ■ ■ < 

"respondent's direct testimony," the data obtained by this - 
method are of "direcot empirical quality." Therefore, 
Richard and Frankel c oncliude*, "there can be no question... 
that the Estimates of accumulation and dupTicatipn extended 
beyond one issue are wrong if those estimates are based on 
the results of only one interview" -- as in the case of the 
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•/ *■ ^ 

Miil method . , - * . 

The validity of 'this ^argument and its conclusion, however 

must be questioned. Richard arid Frankel themselves note 

that, ^VTurnover is. • .the proportion of, the audience from one 

issue 'or tim^ period that would not be part of any other • 

single randomly selected issue or time pe r iod ( Emphas is 

added,.) ^'he SMRB two-interview method--used ,by Richard and 

Frankel as ^^their benchmark — does not meet thiis deJ^inition 

(of coa«r s e , neither does/the MRT ,me th od ) . By interviewing' 

subjects "at least six we?eks apart" the method is .clearly 

' "v ' • ' ■ . ■ 

not randomly choosing a second issue or time period. 

Since neither MRI' s nor' SMRB' s method fulfills the 
d,efinition of turnover, we cannot fconclude through a process 
of lo,gical deduc t i on , : no r . emi^i r ic al testing, which method is 
"right" 'and which is "wirong." ;Ray;^er, we can only hope to . ^ 
identify the differences between t;he two methods, determine 
why they ocSur and choose the method* that best satisfies the, 
propqaed media objectives. With this in mind, we designed 
the present study to examine the differences in turnover 
fate's between ,MRI an'd SMRB, and the coi^ition^ under wfiich 
they may or may not /hold. - • . 
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Study Design ^ .>v^ 

For the present study, we a.re ujsing 1 982 readership d^t^ 

for the 96 titles common 'to SMRB and MRI (the authors thank 

Backer and Spielvogel, Inc. for allowing us access to these 

data). Our analysis focuses on^ a comparison of audience 

turnover rates for the two readership services • Circulation 

size w^ll be controlled for in the analysis in an attempt to 
• 1 

identify aiiy. contingent conditions under which turnover rate 
differences may or may not hold. Circulation figures are 
used for several reasons includ ing' their importance in 
media planning and their preVious use by Richard and Frankel 

C 

(1983). They also provide^an independent measure of 
readership (i.e., circu^l at ion is /determined independentlyof 
SMRB and MRI) . - ' 
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Result 8 ' ^ 
' Examining .the results presented in Table 1, we 
immediat e5.y see that the overall mean turnoyer rate for MRI 
(.34) insignificantly lower than for SMRB (•40), This 
result is ' consistent with Richard and Frankel (1983). -The 
reason for the lower MRI turnover rate is apparently that 
the respondents answering the f r equency-o f -r eading question 
(used in the recent-reading method) tend to report. their 
reading behavior to be ata so me wh at more consistent level 
than if asked at two separate points in time. 

Table 1 also indicates that ftor MRI, turnover increases 

< . . . ' 

progress ively for each 1 owe r circulation level, reaching it6 

highest level of .41 for periodicals with a circulation 

under 500,'000. For SMRB , turnover rates are lowest for 

publications with circulations of five million or more. For 

periodicals with circulations 'below five million there are 

no significant differences in turnove'r rates, although the 

data do show slightly higher turno'\Aer rates for periodicals 

with circulations under one miL-ilTdni 

The data also show that MRI's turnover ^ates are 

sig^iif icantly lower than SMRB's for perio<iical8 of five 

million-plus circulation. Similarly, MRI's turnover rates 

^are markedly lower than SMR^B's for periodicals of 2 million 

to 4,999 ,999, 1 milHo^' to 1,^99 ,999, and 500,(^00 to • 

999,999. Im|]^ rt ant ly ,^ novweve r the differences d^ecrease as 

we move to each 1 owe r level o f c i r cula t ion i la fact, for 

ft . ' 

those, per iodicals with a leir culat'ion below 500,000, we find 



PAGE 9 

that the MRI turnover rate is not significantly less than 
the SMRB rate. 

In other»wor ds , our results indicate that turnover 
systematically decreases for both methods as circulation 
increases. Mo re importantly, t ur nov^ r lev els are 
essentially equal for both methods for publications under 
5^00,000 in circulation. The results, then, directly 
contradict Richard and Frankel wJio state that, "Monthly 
publications above two million in circulation behave no 
differehtly with either method t^ian do those under two 
million in circulation." Our results have several 
implicat ioixs . First,, since turnover systematically 
decreases as circulation increases, ^one must cpn elude that 
readership is more, consistent across i ssues--i . e . , frequency 
w:^l build up^ more quickly-r-f or large circulation 
publications. ^ 

Perhaps more importantly, since there is no difference 
in turnover levels between MRI and SMRB for small 
circulation monthlies, the MRI-SMRB debate is not a one- 
dimensional issue. Rather, we feel that'it entails a 
comjjlex interrelationship of several factors, including in- 
home and out-of-home -©ingle-issue r ^ach es t ima t es , ' 
circulation size and the^f requency'-of-readership measure. 

To explain, since turnover ' is lowest for larger 
circulation pub licat ions , this indicates that reported 
readership cons is tency--as ^elicited from the f requency-of- 
reading question used by MRI--is greater for larger 

10 
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circulation publications. The reason for .this seems most 

likely to stem- from the interaction of c irculat ion s ize and 

in- -and out-of-home readership. Consider the data in Table 

2. For MRI the ratio of in-home to out-of-home readership 

for smac 11 publications is . / / : 1 . For SMRB it is 1.36;1. The 

same statistic for publications over. 500,000 is 1.40;1 for^ • 

yMRI , and 2 . 3 / : 1 f o r SMRB . In other words , in-home ! • 

leadership incr eas,ei§yJ?^o proportion to out-of?home as 

■ V ■ . ^ . • V • , ■ 

circulation increases ^ i N^xt, consider the interaction this * 

would have with a f reqiiency-o f-re.ading question. 

Individuals who Vead a magazine iri their own home probably 

subscribe to it, and read it regularly. Conversely, persons^ 

lio^ read a magazine outside their own home probably only 

read it on occasion, when they are ^in the doctor's office, 

etc. Therefore, we would generally expect lower turnover 

levels for in-home ra ther than out-of-home readers. As a 

result, we would also expect that as in-home teader ship al^^ a 

portion of totaij. readership increases, turnover would 

decrease. Conversely,/ as in- home p^roportionately decreases, 

t urn over would increase. The nega t ive co r r e la t ions , iri table 

3 clearly support thi s . argument (i.e., they show that in- 

. home readership is inversely related to turnover levels , 

while out-of-home readership is either, not related or only 

weakly rexLated to turnover). . 

A logical question might be: since the in-home td out- 

of-home fratio is always greater f^rr SMRB than fox MRI, 

shouldn't SMRB actually have a lower turnover rate than MRI? 
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The. answer is "no" . becau,se MRI uses the * frequency- of ■ 
Tquestxon, while SMRB uses the two-interview method. 
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^ Summary and Conclusion ^ 

In'' confirmation of Richard and Fraud's earlier 
findings, we h^ve found that, in. general , the MRI recent- 
reading method tends* t roduce significantly lower turnover 
levels than the SMRB two-interview. method . In contrast to 
earlier findings, however, we haye also shown that 
differences betVeen the two are contingent upon circulation 
size* Specifically, we have shown that MRI turnover levels 
are no different than those provided by SMRB for 
publications with circulations under 500,000. This finding 
supports our contention that Richard and Frankel may be, 
incorrect in concluding that the MRI method invariably 
produces incorrect turnover estimates — if we assume for a 
moment that the SMRB estimates are "cor rect . " 

Furthermore, we suggest that the reason for this 
finding is based on a complex interaction of these factors: 
the proportion of in-home to out-of-home readers, the 
circulation size, and the frequency-of -reading measure. 

F^^Ily, since both SMRB and MRI define readership 
differently, and neither fulfills the definition of 
turnover, one cannot conclude which method is better. Until 
a valid method of calibrating the two research bureaus' 
figures is discovered (if indeed there is one) , 
determination of which f^-gures to use should be done 
according to the type of advertisement being placed. 

For example, if the ad to- be placed requires a high 
l^vel of reader involvement (e.g., has a large amount of 

13 
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«* 

copy or is very teohnical), SMRB's definition of readership' 
and the figures obtained by^it, would. bette^ fulfill a media 
planner's oby^ectives. But, if the ad is only designed to 
create an image or build brand awaretiess, then MRl's figures^ 
may be more appropriate* 

Thus, before choosing which figures to use, one must 
evaluate the goals and ob j ect iyes of the advertising, and 
then select according to the readership criteria specified 
by each service. But, for those who are still unconvinced, 
Ed Papazian (1980) suggests: "If you are really interested, - 
ask SMRB to send an interviewer over and take you through 
the through- the-book interview. •• and then do the same with 
MRI and the rec ent -r ead ing method... you may come up with 
some ideas of your own." 
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Table 1 

Mean Turnover Rates for MRI and SMRB 
by Circulation* , 



MRI 



SMRB 



Ove ral 1 



.34 



.40 



n-96 



Circulation 
5,000,000+ 



.20 



.30 



n-12 



2 ,000, 000- 
4,999,999 

1,000,000- 
1 ,999, 999 



.33 



.32 



.41 



.40 



n-13 



n-24 



500, 000- 
999,999 



3/ 



.43 



n-30 



<500,000 



.41 



.43 



n-1 / 



*Note: Statistical tests are not run because we are using 
virtually the entire 1982 population of magazines surveyed, 
not a sample. - ' 
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Table 2 



\ 



In-Home and Out-of-Home Readership* for MRI and SliRB 

by Circulation 



MRP 

In Home Out of 
Home 



. SMRB CL/ 
In Home Out of 
Home. 



Circulation 
500,000+ 

Ratio - 

Circulation 
• <500,000 



5/82 



4125 



4/25 



1991 



1.40:1 

(922 1 185, 



2.3/:l 

811 595 



Ratio ( 0.,//:l' 1.36:1 

*Note: Readership figures are in OOO's. i 
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Table 3 



Pearson Correlation Coefficients between 
^urnover and Readership 



MRI 

Turnover 

SMRB 

Tifr nover' 



MRI 



/ 



SMRB 



In-Home 

■ a 



Out-of-Home In-Home Out-of-Home 
Readership Readership" Readership Readership 
-.40 -.19 -.38 -.08 



-.34 



-.09 



-.36 



-.03 



.N=9 6 



18 



